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A "feodl:>ack" system for roport.inq individual pupil variables, 
classroom, school and district wide summaries was designed. The system 
utilized optically scanned forms which produced input filf^s for report 
production. The system was designed so that the numbers and types of 
variables were fixed but that the content of the variables was completely 
flexible to meet widely varying needs from district to district. Con- 
tent lables facilitated interpretation of variables for different grade 
levels and districts. The system was able to provide five working day 
turnaround from the day the forms were received by the central office. 



Introduction 



Our feedback systor* needed to keep tiie custoner satisfied in three 
dimensions -not necessarily orthogonal. Tlie first dimension was level 
of management. The second was the variety of variables to be reported, 
and the third was Individual District requirements, the School District 
of Philadelphia being divided into eight sub-districts each havina its 
own requirements. Althouah the system needed to accommodate any con- 
tent it was developed in cooperation with the district r "«^ding teams. 

Market Survey 

Our first step was to contact the various levels of managers and 
survey them as to their data needs for decision making. A conference 
was held with each District reading team and the systems design staff. 
The District reading team was able to express the managerial needs 
for the District Superintendant , supervisors of reading, reading teachers 
anc classroom teacht^rs • Of course, each District felt their particular 
decisions and the variables needed for them were the most important 
and must be included in the rejx^rts. So, a compromise had to be worked 
out to provide a mix of reported variables that would include most 
of the needs expressed. A major consideration in the compromise was 
the fact that the responsibility for collection of the data lay with 
tho classroom teachv:r, tlierefore the reports would ne*Dd to reflect and 
reqard her efforts in order to make thn system viable. 

Central office curriculvim staff were also interviewed and their 
needs were input into the compromise. 

Wliat did we squeeze out of t h e Compromise ? 

Several other constraints vore also considered. For, instance, 
with how many pages of output could a customer cope in reviewing the 
report he rcceive<3. It was decided that two pages could contain enouah 
information for a decision maker at the classroom level to have mean- 
ingful feedback for each student and to sximmarize the classroom infoxrma- 
tion too. Thus, ^ach classroom teacher report consisted of two pages 
for each reading program, one page was a one-line per pupil report and 
the second a classroom suronarv . 

Principals would receive duplicates of the classroom reports plus 
s^ammary pages for each program within a grade for his school. 

Another constraint was time. We felt that turnaround over one 
week would begin to age the report infoirmation to where it might be use- 
less for decision making especially at the classroom level. So, the 
data reduction, file manipulation, and report generation had to be 
efficient enough to work into the existing computer operations schedule. 

These compromises and constraints led to the final parameters of 
the report system. 



Variol^les Mani})ulaUd: 



Summary Statistics 



I'ltwoii nominal variables 
TV'f> ordinal variai)lt?s 
Riqht int (^rval variahl r:; 



Kroquoncios, Percentaqrs 
Frequencies, Porccntarres , Medians 
U, Mean, sn 



The nominal variables (Yos-No) were used to report services received 
by the pupil or to indicate certain proqram conditions. The two ordinal 
variables reported the Individual Readinq Inventory level and the reading 
program book level. The eight interval variables covered test scores 
and absenteeism expressed as an interval variable. Each variable was 
reported for two points in time so that gains and differences could be 
examined, however, the content of the variables could perteiin to any 
desired. 

To accomodate the fact that each of the eight districts and the 
more than 36 reading proarams over 13 grade levels (K to 12) would require 
that the reported variables be different, a system of header and line 
labels was worked out so that each district could specify its own report 
headers and variable labels for each grade level. Further, the computer 
program was dimensioned to accomodate up to six different reading 
programs in any one grade. 

Each district also custom designed its own data collection form. 
These were OpScan forms on the first year and are now NCS forms. In 
either case the various district forms when scanned produced a data 
record having a common format. In this way the computer program always 
saw the same input variables regardless of a specific district's content. 

Did we keep the customers satisf ied? 

V:oll, v/e hope so, we supplied flexibility across diverse district 
needs by allowing data collection forms # and report labels and headings 
to be customized grade by grade and district by district. Thus, even 
though all the customers were restricted to using the same set of types 
of variabloo they were able to pluq in their own particular information. 
We supplied the needs of various management levels by generating reports 
and summaries meaningful to their particular decision makinq processes, 
and we developed a system which could be executed with the existing 
computer hardware, software and work schedule. 



Figures 1,2, and 3 show Classroom Pupil Report, Classroom Summary 
Report, and School--Grade Summary Report for the "MULTI^LEVEL WITH 
OPER. RSC" reading program. Figure 1 contains a line for each pupil 
showing his or her entries for various variables. A glossary of labels 
is on the bottom of the form. Figure 2 shows a summary for the same 
classroom. Figure 1 and 2 constituted the classroom teacher's report. 

Figure 3 shows the principal's report for the same readinq 
program summarized over all rooms in his or her school. 



ExaJTfples 



I ) i s t r i ' : t. Sunma ry . Ki ;iiro 4 .'ihowr? i District .Siimmiry for a roadini 
procjrain in ^uv^^'io iht. "ho ton thrj^o lin<*s idcntifv thn Rradinn Proqram 
(Mill ti-l<ivri) , All schoolr, in the* Mir;ttict, the oiqhtn 'jradr. All rooms 
witii a pu? i 1 total of 444*J. The roport covors three time nointF; (CKI'T-l , 
CKrT-2, CKrT-3.) ('no of tl\e two ordinal variables i?; reported at tiie toT:> 
section of the paqe. The number, ner<:ont, and median are reported for 
Readinq Program lV'>ok Level for one pu:)il« The aster iks indicated the median. 
'Ilie levels range from "ppl ORA" in the first column to "27" in the second 
column. Three data sunmaries are presented in the center section of the 
paqe. llie left most displays numbers and percents of the total pupils on 
each of tlie eleven nominal indicators. Next to the right is the Absence 
sumii\ary showing tiie numbers, total percent, and medians for two check points. 
On the right center is tlie second ordinal variable disnlav showina number, 
percents, and medians for only punils having this inforrration. Itote that 
the median moved from •'BOOKS*' in CKPT-1 to "B00K6" in CKPT-3, 2432 pupils 
were reported at CKPT-1 while onlv 1968 were reported at CKPT-3. 

At the bottom of tiie paqe are displaved means, standard deviations, 
and total pupils reported for six interval variables at two CKPT'S and 
the differences. Note that while 1815 and 1840 pupils were reported for 
the "AL.rHABETMASTER UC" PRE and POST, means respectively, only 1144 were 
reported in the difference mean. This difference;, calculated by the computer 
program is not the same as 55 minus 44 as it was calculated from only the 
Dupils liaving both PRi-; and POST scores. The other fo\ir variables were 
unlahlod. All values v^ere rounded to the nearest inteaer and not reported 
i f less than one . 

The remaining display in the lower rinht corner contains sometfiina 
labeled I^WA Reading means, .^tand^rd deviations for 1970 and 1971, but 
appears to be two variables expressed on different scales. There is 
also a district identification masthead in the lower right corner. 

Data Collection Form . District Seven designed a two sided NCS form. 
The green side was for use in gradcG one through six while the red side 
was for use in grades seven tiirough twelve. A separate NCS scanning program 
was written for each side o*^ the form. Header targets were used so that 
it was not necessary to enter group information on each pupil's form. The 
form was continuous, that is, the form could be pre-printed with individual 
pupil identification in the masthead areas. Ihis printing included "slugging*' 
targets for the pupil ID number, school, and grade codes. 

System Flow . Figures 6 through 10 show the system flow charts for 
processing data through the system, pre-orinting (Figure 6) and distributing 
forms required one to two weeks. Data collection (marking forms) was done 
by teachers and/or aides* Headers were added and district staff edited the 
form.s before nrooessing on the NCS scanner. Scanning forms, sortina of 
files, and production of reports could be completed in five working days, so 
that reports could be returned in one week after the forms were received by 
the central office. 
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